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o  Abstract 

j> 

Expertise  comprises  experience.  In  solving  a  new  problem,  we  rely 
on  past  episodes.  We  need  to  remember  what  plans  succeed  and  what 
plans  fail.  We  need  to  know  how  to  modify  an  old  plan  to  fit  a  new 
situation.  Case-ba*td  reasoning  is  a  general  paradigm  for  reasoning 
from  experience.  Case-based  reasoning  assumes  a  memory  model  for 
representing,  indexing  and  organizing  past  cases,  and  a  process  model 
for  retrieving  and  modifying  old  cases,  and  assimilating  new  ones. 

Case-based  reasoning  provides  a  scientific  cognitive  model.  The  re¬ 
search  issues  for  case-based  reasoning  include  representation  of  episodic 
knowledge,  memory  organization,  indexing,  planning,  case  modifica¬ 
tion,  and  learning.  In  addition,  computer  implementations  of  case- 
based  reasoning  address  many  of  the  technological  short-comings  of 
standard  rule-based  expert  systems.  These  engineering  concerns  in¬ 
clude  knowledge  acquisition  and  robustness>^-'  '' 

In  this  report  we  review  the  history  ofcase-based  reasoning  includ¬ 
ing  research  conducted  at  the  Yale  -rVi  Project  and  elsewhere. 
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I  have  but  one  lamp  by  which  my  feet  are  guided, 
and  that  is  the  lamp  of  experience. 
I  know  no  way  of  judging  of  the  future  but  by  the  past. 

o  Patrick  Henry.  Sjxeeh  in  Virginia  Convention,  Richmond, 

March  23,  1 775 


1  Introduction 

There  are  two  broad  research  agendas  in  artificial  intelligence  (Al).  The 
first  is  scientific.  We  seek  to  understand  the  nature  of  intelligence  and 
human  thought.  We  examine  a  range  of  human  cognitive  behavior,  including 
memory,  learning,  planning,  and  problem  solving,  and  look  for  principles 
that  play  general  descriptive  and  explanatory  roles.  AI  shares  these  scientific 
ambitions  with  other  cognitive  science  disciplines. 

The  second  agenda  for  Al  research  is  technological.  We  seek  to  create 
intelligent  artifacts  -  machines  that  an  perform  useful  tasks.  We  wish 
to  develop  the  technology  of  intelligence.  We  want  to  be  able  to  design 
and  build  computer  programs  that  can  solve  problems  and  adapt  to  new 
situations. 

In  this  report,  we  discuss  case-based  reasoning,  an  AI  paradigm  that 
addresses  both  research  agendas.  Case-based  reasoning  is  a  psychological 
theory  of  human  cognition.  It  addresses  issues  in  memory,  learning,  plan¬ 
ning,  and  problem  solving.  Case- based  reasoning  also  provides  a  foundation 
for  a  new  technology  of  intelligent  computer  systems  that  can  solve  problems 
and  adapt  to  new  situations. 

We  shall  first  review  the  underlying  psychological  model  of  case-based 
reasoning.  We  then  shall  examine  several  computer  models  that  embody 
the  principles  of  case-based  reasoning,  contrasting  the  case-based  approach 
with  the  rule-based  expert  system  paradigm. 

2  Models  of  Memory 

An  intelligent  being  requires  knowledge  about  the  world.  Knowledge  allows 
a  person  to  plan  and  solve  problems.  Knowledge  is  a  resource,  a  commodity. 
Memory  is  the  repository  of  knowledge.  The  question  for  the  psychologist 
has  been  what  theory  of  memory  accounts  for  observed  cognitive  behaviors. 
The  question  for  the  AI  researcher  has  been  how  to  represent  knowledge  in 
a  computer  program. 
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2.1  Semantic  and  Episodic  Memory 

These  questions  have  converged  as  Ai  researchers  have  attempted  to  cre¬ 
ate  computer  programs  that  model  cognitive  processes.  A  leading  theory 
has  been  the  semantic  network  memory  model.  Psychologists  have  de¬ 
voted  much  attention  to  this  theory  [C'QG9,  R.LN72,  I\in72],  as  have  AT 
researchers  [QuiGS,  \Voo75], 

Semantic  networks  typically  represent  static  facts  about  the  world,  such 
as,  “Fido  is  a  dog,”  "A  dog  is  a  mammal,”  and  ^Mammals  have  hair.”  In 
general,  this  type  of  knowledge  does  not  change  over  time. 

Psychologists  and  AI  researchers  realized  that  semantic  networks  did  not 
account  for  all  the  data.  First,  not  all  knowledge  is  in  small,  static  chunks. 
Memories  are  variable  in  size  and  malleable  in  content.  Second,  the  semantic 
network  theory  did  not  explain  how  knowledge  is  incorporated  into  memory. 
Where  did  the  information  come  from?  It  is  clear  that  we  are  not  born  with 
an  innate  knowledge  of  the  world. 

To  address  these  and  other  questions,  Tulving  proposed  a  theory  of 
episodic  memory  [Tul72,  TulS3]  as  an  adjunct  to  semantic  memory.  Tulving 
described  semantic  and  episodic  memory  as  two  complementary  information 
processing  systems,  both  of  which  perform  the  following  actions: 

•  receive  information  from  perceptual  and  cognitive  systems. 

•  process  portions  of  the  information. 

•  communicate  information  to  other  behavioral  and  cognitive  systems. 

Semantic  and  episodic  memory,  according  to  Tulving,  differ  by  the  following 
features: 

•  the  type  of  information  stored. 

•  autobiographical  reference  versus  cognitive  reference. 

•  retrieval  conditions  and  consequences. 

•  volatilitiy  of  stored  information. 

•  interdependence. 


More  specifically. 
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Episodic  memory  receives  and  stores  information  about  tempo¬ 
rally  dated  episodes  or  events,  and  temporal-spatial  relations 
among  these  events.  A  perceptual  event  can  be  stored  in  the 
episodic  system  solely  in  terms  of  its  perceptible  properties  or  at¬ 
tributes,  and  it  is  always  stored  in  terms  of  its  autobiographical 
reference  to  the  already  existing  contents  of  the  episodic  mem¬ 
ory  store.  The  act  of  retrieval  of  information  from  the  episodic 
store,  in  addition  to  making  the  retrieval  contents  accessible  to 
inspection,  also  serves  as  a  special  type  of  input  into  episodic 
memory  and  thus  changes  the  contents  of  the  episodic  memory 
store.  [Tul72] 

Episodic  memory  provided  an  account  of  representing  and  recalling  larger 
chunks  of  temporally  related  information  -  events,  scenes,  occurrences,  sto¬ 
ries.  By  contrast,  “semantic  memory  is  the  memory  necessary  for  the  use  of 
language.  It  is  mental  thesaurus.”  [Tul72] 

2.2  Conceptual  Memory 

In  parallel  with  the  identification  of  episodic  memory  by  psychologists,  AI 
researchers  had  arrived  at  a  similar  theory  for  language  understanding  tasks. 
Schank  and  his  students  had  developed  natural  language  systems  for  rep¬ 
resenting  concepts  and  understanding  single  sentences  [Sch72,  Sch75aj.  A 
sentence  such  as  “John  ate  a  hamburger.”  could  be  processed,  paraphased, 
and  translated  to  another  language.  The  next  step  was  to  process  connected 
text  -  paragraphs  and  stories.  For  this  task,  Schank  proposed  a  conceptual 
memory  [Sch75b]  that  combined  semantic  memory  with  Tulving’s  episodic 
memory. 

The  distinction  between  semantic  memory  and  episodic  mem¬ 
ory  is  a  false  one.  We  shall  argue  that  what  must  be  present 
is  a  lexical  memory  which  contains  all  of  the  information  about 
words,  idioms,  common  expressions  etc.,  and  which  links  these 
to  nodes  in  a  conceptual  memory,  which  is  language  free.  We 
believe  that  it  is  semantic  memory  rather  than  episodic  mem¬ 
ory  which  is  the  misleading  notion.  Once  we  change  semantic 
memory  by  separating  out  lexical  memory,  we  are  left  with  a  set 
of  associations  and  other  relations  between  concepts  that  could 
only  have  been  acquired  by  personal  experience.  We  claim  that 
conceptual  memory,  therefore,  is  episodic  in  nature.  [Sch75b] 
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A  key  feature  of  Schank's  conceptual  memory  is  the  notion  that  infor¬ 
mation  is  derived  from  experience.  Knowledge  is  not  innate.  A  theory  of 
memory  must  account  for  the  acquisition  of  knowledge. 

2.3  Scripts,  MOPs,  and  Reminding 

At  this  time,  Scliank  and  Abelson  proposed  knowledge  structures  for  repre¬ 
senting  episodic  information  [SA75,  SA77].  The  primary  knowledge  struc¬ 
ture  was  the  script.  Scripts  accounted  for  information  about  stereotypical 
events,  such  as  going  to  a  restaurant,  taking  a  bus,  or  visiting  the  dentist. 
In  such  common  situations,  a  person  has  a  set  of  expectations  concerning 
the  default  setting,  goals,  props,  and  behaviors  of  the  other  people  involved. 
Scripts  are  analogous  to  Minsky’s  frames  [Min75]  which  were  proposed  in 
the  context  of  visual  processing.  It  is  important  to  note  that  scripts  are 
directly  related  to  autobiographical  events.  Scripts  are  inherently  episodic 
in  origin  and  use.  That  is,  scripts  arise  from  experience  and  are  applied  to 
understand  new  events. 

Scripts  were  proposed  as  a  knowledge  structure  for  a  conceptual  mem¬ 
ory.  The  acquisition  of  scripts  was  a  result  of  repeated  exposure  to  a  given 
situation.  For  example,  children  learn  the  restaurant  script  by  going  to 
restaurants  over  and  over  again. 

As  a  psychological  theory  of  memory,  scripts  suggested  that  people  would 
remember  events  in  terms  of  their  associated  script.  However,  an  experiment 
by  Bower,  Black,  and  Turner  [BBT79]  showed  that  subjects  often  confused 
events  that  had  similar  scripts.  For  example,  a  subject  might  mix  up  scenes 
from  a  visit  to  a  doctor’s  office  with  a  visit  to  a  dentist’s  office. 

These  data  required  a  revision  in  script  theory.  What  knowledge  struc¬ 
tures  would  allow  for  such  confusion?  What  was  the  underlying  process  of 
remembering? 

Schank  postulated  a  more  general  knowledge  structure  to  account  for  the 
diverse  and  heterogeneous  nature  of  episodic  knowledge.  The  new  structure 
was  the  Memory  Organization  Puckct  or  MOP  [Sch79,  SchSO,  Sch82].  MOPs 
might  be  viewed  as  Meta-scripts.  For  example,  instead  of  a  dentist  script  or 
a  doctor  script,  there  might  lie  a  Professional-Office-Visit  MOP  that  can  be 
instantiated  and  specified  for  both  the  doctor  and  the  dentist. 

More  important  than  the  MOP  knowledge  structure  was  the  new  em¬ 
phasis  on  the  basic  memory  processes  of  reminding  and  learning.  The  early 
work  of  Bartlett  [Bar32]  on  remembering  had  influenced  the  original  design 
of  scripts  for  story  comprehension  [Sell 75b],  The  new  focus  on  reminding 
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raised  additional  questions  about  how  memory  was  organized  and  indexed. 
Schank  illustrated  this  phenomenon  with  sample  remindings,  such  as  the 
following,  gathered  informally  from  colleagues  and  students. 

The  steak  and  the  haircut. 

X  described  how  his  wife  would  never  make  his  steak  as  rare  as 
he  liked  it.  When  this  was  told  to  Y,  it  reminded  Y  of  a  time,  30 
years  earlier,  when  he  tried  to  get  his  hair  cut  in  a  short  style  in 
England,  and  the  barber  would  not  cut  it  as  short  as  he  wanted 
it. 

The  sand  dollars  and  the  drunk. 

X’s  daughter  was  diving  for  sand  dollars.  X  pointed  out  where 
there  were  a  great  many  sand  dollars,  but  X’s  daughter  continued 
to  dive  where  she  was.  X  asked  why.  She  said  that  the  water 
was  shallower  where  she  was  diving.  This  reminded  X  of  the 
joke  about  the  drunk  who  was  searching  for  his  ring  under  the 
lamppost  because  the  light  was  better  there  even  though  he  had 
lost  the  ring  elsewhere.  [SchS2] 

The  remindings  in  these  two  stories  have  very  little  to  do  with  the  surface 
features  of  the  episodes.  Cooking  a  steak  and  cutting  hair  are  hardly  similar 
events,  yet  the  stories  are  related.  These  examples  illustrate  the  fact  that 
memory  has  a  complex  structure  and  indexing  that  allows  people  to  relate 
a  new  episode  to  prior  cases  through  thematic  and  abstract  categories. 

Given  this  richly  indexed  structure,  Schank  proposed  a  theory  of  learning 
based  on  reminding.  If  we  assume  that  new  situations  or  experiences  will 
remind  us  of  previous  cases  and  events,  we  can  classify  a  new  episode  in 
terms  of  past  cases.  The  knowledge  of  the  past  case,  like  a  script,  can  guide 
our  behavior.  We  can  rely  on  the  past  episode  to  help  us  understand  a  new 
situation.  For  example,  the  second  time  we  ride  on  an  airplane,  we  will  be 
reminded  of  our  first  airplane  trip.  We  can  use  that  experience  to  remind  us 
to  get  a  boarding  pass,  find  our  seat,  stow  our  luggage,  fasten  the  seatbelt, 
etc. 

However,  when  the  new  situation  does  not  conform  to  the  prior  case, 
we  have  a  failure.  That  is.  we  had  an  expectation  based  on  a  prior  event 
that  did  not  occur  in  the  new  situation.  Thus,  we  must  classify  this  new 
situation  as  being  different  from  the  previous  episode.  We  must  remember 
this  new  experience.  We  must  learn.  Schank  termed  this  process  failure- 
driven  learning  [SchSl].  Returning  to  our  airplane  example,  if  we  have  flown 
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several  times,  but  then  take  the  air  shuttle  for  the  first  time,  we  will  have 
some  surprises.  Our  expectations  to  have  an  assigned  seat  and  to  buy  our 
ticket  ahead  of  time  fail.  We  must  recognize  these  discrepancies  and  account 
for  them.  We  must  modify  our  knowledge  structure  for  airplane  rides  so  that 
the  next  time  we  take  the  air  shuttle,  we  will  know  better  what  to  expect. 

When  we  observe  a  discrepancy  between  our  predictions  and  some  event, 
we  then  have  something  to  learn.  We  need  to  revise  our  knowledge  struc¬ 
ture.  The  mechanism  lor  updating  our  knowledge  often  requires  explanation. 
Schank  noted  that  explanation  plays  a  central  role  in  learning  and  intelli¬ 
gence  [Sch86a].  He  proposed  an  explicit  knowledge  structure,  explanation 
patterns  ( XPs ),  that  are  used  to  generate,  index,  and  test  explanations  in 
conjunction  with  an  episodic  memory. 

2.4  Process  Model 

We  began  with  the  intent  of  representing  knowledge  and  thence  deriving  a 
theory  of  memory  to  account  for  episodic  information.  Scripts  and  MOPs 
were  postulated  as  knowledge  structures  for  representing  experience.  How¬ 
ever,  the  knowledge  structures  provide  only  part  of  the  answer.  We  must  also 
specify  the  processes  involved  in  acquiring  and  accessing  these  structures. 
We  require  a  process  model. 

In  figure  1  (after  [RB87]),  we  present  a  flow  chart  that  illustrates  the 
basic  process  of  case-based  reasoning  and  learning. 

In  that  figure,  boxes  represent  processes  and  ovals  represent  knowledge 
structures.  The  process  of  interpreting  and  assimilating  a  new  event  is 
broken  down  in  the  following  steps,  starting  with  an  input  event  at  the  top 
of  the  flow  chart. 

1.  Assign  Indices.  Features  of  the  new  event  are  assigned  as  indices 
characterizing  the  event.  For  example,  our  first  air  shuttle  flight  might 
be  characterized  as  “airplane  flight.” 

2.  Retrieve.  The  indices  arc  used  to  retrieve  a  similar  past  case  from 
memory.  The  past  case  contains  the  prior  solution.  In  our  example, 
we  might  be  reminded  of  our  last  airplane  trip. 

3.  Modify.  The  old  solution  is  modified  to  conform  to  the  new  situation, 
resulting  in  a  proposed  solution.  For  our  airplane  case,  we  would  make 
appropriate  modifications  to  account  for  changes  in  various  features 
such  as  destination,  price,  purpose  of  the  trip,  departure  and  arrival 
times,  weather,  etc. 
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Figure  1:  Ca.se- based  Reasoning  Flow  Chart 
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4.  Test.  The  proposed  solution  is  tried  out.  It  either  succeeds  or  fails. 
Our  airplane  reminding  generates  certain  expectations,  not  all  of  which 
may  be  met. 

5.  If  success,  then  Assign  Indices  and  Store  working  solution.  The  suc¬ 
cessful  plan  is  then  incorporated  into  the  case  memory.  For  a  normal 
airplane  trip,  there  will  be  few  expectation  fed  lures  and  therefore  little 
to  make  this  new  trip  memorable.  It  will  be  just  one  more  instance  of 
the  airplane  script. 

6.  If  failure,  then  Explain  the  failure,  Repair  working  solution,  and 
Test  again.  The  explanation  process  identifies  the  source  of  the  prob¬ 
lem.  The  predictive  features  of  the  problem  are  incorporated  into  the 
indexing  rules  to  anticipate  this  problem  in  the  future.  The  failed  plan 
is  repaired  to  fix  the  problem  and  the  revised  solution  is  then  tested. 
For  our  air  shuttle  example,  we  realize  that  certain  expectations  fail. 
We  learn  that  we  do  not  get  an  assigned  seat  and  that  we  do  not  have 
to  pay  ahead  of  time.  We  may  decide  that  taking  the  air  shuttle  is 
more  like  riding  on  a  train.  We  then  can  create  a  new  case  in  memory 
to  handle  this  new  situation  and  identify  predictive  features  so  that 
we  will  be  reminded  of  this  episode  the  next  time  we  take  the  shuttle. 

In  support  of  this  process  are  the  following  types  of  knowledge  structures, 
represented  by  ovals  in  the  figure. 

•  Indexing  Rules.  These  rules  identify  the  predictive  features  in  the 
input  that  provide  appropriate  indices  into  the  case  memory.  Deter¬ 
mining  the  significant  input  features  is  a  persistent  problem  [SCH86b]. 

•  Case  Memory.  This  is  the  episodic  memory,  which  comprises  the 
database  of  experience. 

•  Similarity  Metrics.  If  more  than  one  case  is  retrieved  from  episodic 
memory,  the  similarity  metrics  can  be  used  to  decide  which  case  is 
more  like  the  current  situation.  For  example,  in  the  air  shuttle  case, 
we  might  be  reminded  of  both  airplane  rides  and  train  rides.  The 
similarity  rules  might  suggest  initially  to  rely  on  the  airplane  case. 

•  Modification  Rules.  No  old  case  is  going  to  be  an  exact  match  for 
a  new  situation.  The  old  case  must  be  modified  to  fit.  We  require 
knowledge  about  what  kinds  of  things  can  be  changed  and  how  to 
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change  them.  For  the  airplane  ride,  it  is  acceptable  to  ride  in  a  different 
seat,  but  it  is  usually  not  advisable  to  change  roles  from  passenger  to 
pilot. 

•  Repair  Rules.  Once  we  have  identified  and  explained  an  expectation 
failure,  we  must  try  to  alter  our  plan  to  fit  the  new  situation.  Again, 
we  have  rules  for  what  kinds  of  changes  are  permissible.  For  the  air 
shuttle,  we  recognize  that  paying  for  the  ticket  on  the  plane  is  an 
acceptable  change. 

2.5  Psychological  Issues 

The  process  model  depicted  in  figure  1  is  not  meant  to  stipulate  the  necessary 
and  sufficient  conditions  for  simulating  cognitive  behavior.  Rather,  it  is 
presented  as  illustrative  of  a  variety  of  salient  issues  in  case-based  reasoning. 

We  can  summarize  the  psychological  assumptions  of  the  case-based  rea¬ 
soning  paradigm  as  follows. 

•  Memory  is  predominantly  episodic.  The  primary  content  of  memory 
is  experience. 

•  Memory  is  richly  indexed.  Experiences  are  related  to  each  other  in 
many  complex  and  abstract  ways. 

•  Memory  is  dynamic.  The  organization  and  structure  of  memory  changes 
over  time. 

•  Experience  guides  reasoning.  We  interpret  and  understand  new  situa¬ 
tions  in  terms  of  prior  experience. 

•  Learning  is  triggered  by  failure.  When  an  expectation  from  a  previous 
case  fails  to  predict  a  new  situation,  we  learn  through  incorporating 
the  new  episode  into  memory. 

Similarly,  we  can  present  the  research  questions  that  arise  from  these 
respective  assumptions. 

•  What  comprises  a  ca sc?  What  is  the  content  and  structure  of  an 
episode  in  memory?  What  is  the  relationship  between  episodic  mem¬ 
ory  and  other  types  of  knowledge?  How  can  we  represent  Case  Mem¬ 
ory? 
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•  How  is  memory  organized?  What  set  of  indices  are  appropriate  for 
classifying  cases?  What  search  algorithms  complement  the  structure 
of  memory?  What  are  the  Indexing  Rules? 

•  How  does  memory  change?  What  leads  to  forgetting?  How  does  the 
memory  of  cases  and  stories  degrade?  How  do  the  Case  Memory  and 
Indexing  Rules  change  over  time? 

•  How  can  we  adapt  old  solutions  to  new  problems?  How  can  we  recog¬ 
nize  a  new  situation  as  being  similar  to  a  previous  episode?  What  are 
the  Similarity  Metrics  and  Modification  Rules? 

•  What  leads  us  to  reject  or  accept  a  new  case  that  is  in  conflict  with  a 
previous  case?  IIow  do  we  explain  the  differences  between  episodes? 
How  can  we  learn  from  mistakes?  What  are  the  Repair  Rules? 

It  may  seem  that  we  are  presenting  more  questions  than  answers.  How¬ 
ever,  our  basic  premise  is  that  case-based  reasoning  provides  a  foundation 
for  a  broad  range  of  research.  It  is  appropriate  and  indeed  desirable  to 
stimulate  research  through  the  principled  identification  and  examination  of 
cognitive  phenomena. 

We  now  turn  to  review  the  history  of  case-based  reasoning  in  artificial 
intelligence  research. 

3  Computer  Models 

The  first  computer  programs  to  use  scripts  were  SAM  (Script  Applier  Mech¬ 
anism)  [Cul78],  and  FRUMP  (Fast  Reading  Understanding  Memory  Pro¬ 
gram)  [DeJ79],  These  programs  read  newspaper  stories  and  performed  vari¬ 
ous  language  tasks,  such  as  translation,  summarization,  and  answering  ques¬ 
tions.  These  programs  contained  static  knowledge  structures  that  were  used 
in  processing  stories.  The  content  of  the  programs’  memory  did  not  change 
as  a  result  of  processing  -  in  spite  of  the  “memory”  in  FRUMP’s  name. 

These  programs  were  a  successful  demonstration  of  natural  language 
processing  of  stories,  and  of  scripts  as  a  knowledge  structure.  Understand¬ 
ing  a  story  entailed  processing  an  episode  or  event.  Scripts  provided  a 
feasible  means  for  representing  such  episodic  knowledge.  However,  the  pro¬ 
grams  failed  to  demonstrate  knowledge  acquisition.  The  scripts  of  SAM  and 
FRUMP  were  innate,  as  it  were,  having  been  written  by  programmers.  The 
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programs  used  the  scripts  to  guide  processing  of  stories,  but  the  programs 
did  not  learn  their  scripts  through  experience. 

Furthermore,  the  programs  did  not  remember  anything.  SAM  or  FRUMP 
could  read  the  same  story  twenty  times  in  a  row  and  not  recognize  that  it 
had  previously  seen  that  story.  Clearly  a  program  that  modeled  human 
memory  should  remember  its  own  experience. 

Two  programs  followed  that  addressed  the  issue  of  memory  organiza¬ 
tion  for  episodic  knowledge:  CYRUS  and  IPP.  The  first  was  Kolodner’s 
CYRUS  [K0I8O,  SI\79.  Kol84,  KC86],  The  CYRUS  program  simulated  an 
episodic  memory  of  events  relating  to  former  Secretary  of  State  Cyrus  Vance. 
The  program  would  answer  questions  about  a  range  of  “autobiographical” 
episodes,  such  as  meetings,  diplomatic  trips,  and  state  dinners.  CYRUS  was 
the  first  program  to  model  episodic  storage  and  retrieval  strategies.  While 
the  focus  of  CYRUS  was  on  memory  organization  and  indexing,  there  was 
also  an  attempt  to  integrate  CYRUS  with  the  FRUMP  newswire  program 
to  provide  an  automatic  update  for  CYRUS’s  memory  [SKD80].  The  com¬ 
bined  system,  CyFr,  would  read  news  stories  about  the  Secretary  of  State 
and  integrate  the  events  into  CYRUS’s  episodic  memory. 

Lebowitz’  IPP  [LebSO]  provided  a  prototype  for  case-based  reasoning 
and  learning  programs.  IPP  read  news  stories  about  terrorist  acts,  such  as 
bombings,  kidnappings,  and  shootings.  The  program  started  with  generic 
knowledge  about  such  acts,  and  after  reading  hundreds  of  stories,  devel¬ 
oped  its  own  set  of  generalizations  about  terrorism  that  it  could  apply  to 
understanding  new  stories.  We  have  included  a  sample  protocol  from  IPP 
in  Appendix  A.  In  that  example,  the  program  reads  two  stories  about 
IRA  terrorism  in  Northern  Ireland.  The  program  notices  that  the  victims 
are  establishment,  authority  figures  (policemen  and  soldiers),  and  that  the 
terrorists  are  members  of  the  IRA.  IPP  then  reads  a  third  story  about  a 
shooting  in  Northern  Ireland,  and  the  program  infers  that  the  unidentified 
gunman  is  a  member  of  the  IRA. 

3.1  Expert  Systems:  Rules  vs.  Cases 

The  programs  from  the  late  1970’s  that  modeled  episodic  memory  were 
largely  natural  language  processing  programs.  At  that  time,  another  topic 
of  AI  research  had  developed  into  a  primary  area  of  applications,  namely 
rule-based  expert  systems.  Early  programs  such  as  DENDRAL  [BSF69]  and 
MYCIN  [Sho76]  had  demonstrated  the  possibility  of  simulating  the  problem 
solving  ability  of  human  experts,  such  as  chemists  or  physicians.  The  success 
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of  these  and  other  programs  stimulated  interest  in  developing  expert  systems 
for  a  vast  number  of  technical  applications. 

The  basic  unit  of  knowledge  in  these  expert  systems  was  the  rule.  A  rule 
comprised  a  conditional  test-action  pair,  e.g.,  IF  condition,  THEN  action. 
Several  hundred  rules  might  be  required  for  handling  a  typical  diagnostic  or 
repair  task. 

Building  rule-based  or  production  systems  became  a  popular  enterprise. 
As  experience  with  expert  systems  increased,  so  did  awareness  of  some  basic 
short-comings  of  the  rule- based  system  paradigm. 

The  first  problem  was  knowledge  acquisition.  In  order  to  build  an  expert 
system,  a  computer  programmer  (or  knowledge  engineer)  had  to  sit  down 
with  the  human  expert  informant  to  determine  what  rules  were  appropriate 
for  the  given  domain.  This  knowledge  was  difficult  to  uncover.  The  human 
expert  could  not  simply  make  a  list  of  the  hundreds  of  rules  he  used  to 
solve  problems.  Often  the  informant  would  articulate  a  set  of  rules  that 
in  fact  would  not  accurately  reflect  his  own  problem  solving  behavior.  For 
these  reasons,  this  difficult  knowledge  acquisition  process  became  known  as 
a  bottleneck  in  constructing  rule-based  expert  systems  [HWL83]. 

Second,  the  rule-based  systems  did  not  have  a  memory.  That  is,  just  as 
SAM  and  FRUMP  would  not  remember  news  stories  that  they  had  already 
read,  rule-based  systems  would  not  remember  problems  that  they  had  al¬ 
ready  solved.  For  example,  if  a  medical  diagnosis  program  is  presented  with 
a  patient  with  a  certain  set  of  symptoms,  the  program  may  fire  dozens  or 
hundred  or  thousands  of  rules  and  come  up  with  a  diagnosis  or  treatment. 
Subsequently,  if  the  program  is  presented  with  another  patient  displaying 
the  same  set  of  symptoms,  the  program  will  fire  the  same  set  of  rules  as 
before.  The  program  will  not  remember  having  previously  seen  a  similar  pa¬ 
tient.  One  might  argue  that  this  observation  is  of  little  consequence  beyond 
some  argument  for  computational  efficiency.  However,  a  program  without  a 
memory  will  not  remember  its  mistakes,  and  thus,  will  be  destined  to  repeat 
them. 

Third,  rule-based  systems  were  not  robust.  If  a  problem  were  presented 
to  the  system  that  did  not  match  any  of  the  rules,  the  program  could  not 
respond.  The  system’s  knowledge  base  was  limited  to  its  rules,  so  if  none  of 
the  rules  could  apply,  the  system  had  no  alternatives. 

We  may  compare  the  behavior  of  the  rule-based  expert  system  with  the 
behavior  of  the  human  expert.  The  central  feature  of  expertise  is  experi¬ 
ence.  An  expert  is  someone  who  has  vast,  specialized  experience,  who  has 
witnessed  numerous  cases  in  the  domain,  and  who  has  generalized  this  ex- 


3  COMPUTER  MODELS 


13 


perience  to  apply  it  to  new  situations.  When  confronted  with  a  problem, 
the  expert  is  reminded  of  previous,  similar  problems  and  their  respective 
resolutions.  It  may  be  that  the  expert  has  so  many  exemplars  for  a  given 
problem  that  the  experiences  have  been  distilled  into  a  general  rule  to  be 
applied. 

Thus,  the  human  expert  derives  knowledge  from  experience.  The  ba¬ 
sic  unit  of  knowledge  is  not  the  rule,  but  the  case.  Human  experts  acquire 
knowledge  by  assimilating  new  cases,  either  first-hand  or  through  the  reports 
of  others.  Furthermore,  it  is  easier  for  people  to  articulate  knowledge  in  the 
form  of  experience  than  as  rules.  This  observation  suggests  the  psycholog¬ 
ical  hypothesis  that  expert  knowledge  may  in  fact  be  encoded  primarily  as 
episodes,  rather  than  as  rules.  We  contrast  this  acquisition  of  knowledge 
from  experience  with  the  knowledge  acquisition  bottleneck  given  above  as 
the  first  problem  of  rule-based  systems. 

Second,  human  experts  remember  their  own  experience.  The  doctor  who 
fails  to  treat  a  case  effectively  should  remember  that  case  when  another  pa¬ 
tient  presents  the  same  symptoms.  The  doctor  can  learn  from  his  mistakes. 

Third,  human  experts  can  reason  by  analogy.  If  our  doctor  sees  a  pa¬ 
tient  who  presents  symptoms  that  are  unlike  anything  in  his  experience,  the 
doctor  need  not  simply  give  up.  The  doctor  might  be  reminded  of  various 
previous  cases  that  were  similar  in  one  way  or  another,  and  devise  a  treat¬ 
ment  accordingly.  Just  as  our  first  air  shuttle  trip  might  remind  of  us  of 
both  an  airplane  trip  and  a  train  ride,  the  doctor  might  be  able  to  arrive  at 
a  composite  diagnosis  based  on  different  earlier  cases. 

These  arguments  suggest  an  alternative  to  the  rule-based  system:  a  case- 
based  system.  An  expert  system  that  can  extract  information  from  its  ex¬ 
perience  will  be  able  to  grow  and  acquire  knowledge  on  its  own.  This  is  a 
crucial  step  for  the  long-range  success  of  the  expert  system  concept  in  AI. 
There  are  so  many  tasks  to  which  automated  reasoning  power  might  be  ap¬ 
plied,  that  it  is  necessary  to  develop  a  mechanism  that  can  assimilate  new 
knowledge  directly  from  experience. 

The  technology  of  case- based  systems  directly  addresses  problems  found 
in  rule-based  systems. 

•  Knowledge  acquisition.  The  unit  of  knowledge  is  the  case,  not  the  rule. 
It  is  easier  articulate,  examine,  and  evaluate  cases  than  rules. 

•  Performance  experience.  A  case-based  system  can  remember  its  own 
performance  and  modify  its  future  behavior  to  avoid  repeating  prior 
mistakes. 
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•  Adaptive  solutions.  By  reasoning  from  analogy  with  past  cases,  a  case- 
based  system  should  be  able  to  construct  solutions  to  novel  problems. 

The  scientific  research  issues  given  for  case-based  reasoning  models  in 
section  2.5  also  apply  directly  to  the  technological  research  issues  for  case- 
based  systems.  We  must  answer  those  same  questions  in  building  case-based 
systems. 

•  What  comprises  a  case?  How  can  we  represent  Case  Memory? 

•  How  is  memory  organized?  What  are  the  Indexing  Rules? 

•  How  does  memory  change?  How  do  the  Case  Memory  and  Indexing 
Rules  change  over  time? 

•  How  can  we  adapt  old  solutions  to  new  problems?  What  are  the 
Similarity  Metrics  and  Modification  Rules? 

•  How  can  we  learn  from  mistakes?  What  are  the  Repair  Rules? 

The  technology  of  case- based  systems  is  an  instantiation  of  the  psycho¬ 
logical  theories  of  case-based  reasoning.  CYRUS  and  IPP  can  be  viewed  as 
prototypes  for  case-based  systems.  In  the  19S0’s,  researchers  began  explic¬ 
itly  to  develop  case- based  systems. 

3.2  Case-based  Systems 

One  of  the  first  case-based  expert  systems  was  Simpson’s  MEDIATOR 
[KSS85,  Sim85].  The  program  acted  as  an  advisory  system  for  dispute  me¬ 
diation.  MEDIATOR  would  be  presented  with  a  dispute  situation  between 
two  parties  and,  based  on  its  experiential  knowledge  base,  suggest  a  reso¬ 
lution.  The  program  addressed  problems  of  similarity  measures,  memory 
structures  for  representing  and  retrieving  cases,  adaptation,  and  recovery 
from  failure. 

Simpson  proposed  the  following  problem  solving  principles  that  charac¬ 
terize  case-based  reasoning  systems  [SimS5]. 

1.  Including  a  capability  for  case-based  reasoning  in  a  problem  solving 
system  allows  previous  computations  to  be  used  to  suggest  solutions 
to  new  problems,  potentially  cutting  down  the  work  required  to  solve 
a  difficult  problem  from  scratch. 
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2.  Case-based  reasoning  requires  access  to  a  dynamic  memory  capable  of 
storing  and  retrieving  previous  experience. 

3.  Case-based  reasoning  requires  that  a  problem  solver  be  able  to  recog¬ 
nize  similarity  between  cases  so  that  only  those  potentially  applicable 
to  the  current  problem  are  recalled. 

4.  Case-based  reasoning  requires  choosing  the  most  appropriate  case  from 
a  set  of  potentially  applicable  ones. 

5.  Case-based  reasoning  requires  that  the  problem  solver  be  able  to  trans¬ 
fer  the  appropriate  information  from  one  case  to  another. 

6.  Case-based  reasoning  requires  that  the  problem  solver  must  receive 
feedback  and  be  able  to  evaluate  its  decisions. 

7.  Problem  solvers  must  be  able  to  recover  from  reasoning  failures. 

Bain  applied  the  case-based  approach  to  legal  reasoning.  Bain  observed 
lawyers  and  judges  in  the  context  of  sentencing  convicted  criminals.  His 
program,  JUDGE  [Bai84,  BaiSG],  simulated  the  process  of  a  judge  deciding 
the  appropriate  sentence  to  mete  out,  based  on  the  judge’s  experience. 

The  following  is  a  brief  example  from  JUDGE.  The  program  is  given  a 
new  case,  CRIHE8,  which  has  features  that  remind  JUDGE  of  a  previous  as¬ 
sault  case,  CRIME1.  JUDGE  compares  the  two  cases  to  decide  what  sentence 
should  be  imposed  in  the  new  case.  The  program  explains  its  reasoning  as 
it  goes  along. 

CRIME8  Facts: 

First,  Tsrry  struck  Saa  with  his  fists  savaral  tinas. 

San  was  only  slightly  hurt. 

[Intarprstad  as  UNPROVOKED-VIOLATION] 

lazt,  Saa  struck  Tarry  with  his  fists  savaral  tiaas. 

Tarry  was  only  slightly  hurt. 

[Intarprstad  as  PARITY-SELF-DEFENSE  with  an  ACHIEVED- RESULT] 

Finally,  Tarry  struck  Saa  with  his  fists  savaral  tiaas. 

Saa  racaivad  a  concussion. 

[Intarprstad  as  PARITY-RETALIATION  with  a  VIOLATIVE-ACCIDENTAL-RESULT.] 
THE  ONLY  THEMATICALLY  SIMILAR  PREVIOUS  SITUATION  IN  MEMORY  WAS 
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CRIME 1 .  CRIME1  CONTAINED  A  SIMILAR  FINAL  INTENTION  AND  RESULT 
INTERPRETATION  AS  CRIMES . 

...Comparing  CRIME1  from  memory  with  the  current  input,  CRIME8... 
The  old  crime,  CRIME1,  once  again,  involved  the  following: 


First,  Randy  struck  Chuck  with  his  fists  several  times. 

Chuck  was  only  slightly  hurt. 

[Interpreted  as  UNPROVOKED-VIOLATION] 

Next,  Chuck  struck  Randy  with  his  fists  several  times. 

Randy  was  only  slightly  hurt. 

[Interpreted  as  PARITY-SELF-DEFENSE  with  an  ACHIEVED-RESULT] 

Then,  Randy  slashed  at  Chuck  with  a  knife  one  time. 

Chuck's  skin  was  slightly  cut. 

[Interpreted  as  ESCALATED-RETALIATION  with  a  BUNGLED-RESULT.] 

Next,  Chuck  slashed  at  Randy  with  a  knife  one  time. 

Randy's  skin  was  slightly  cut. 

[Interpreted  as  PARITY-SELF-DEFENSE  with  a  BUNGLED-RESULT.] 

Finally,  Randy  stabbed  Chuck  with  a  knife  several  times. 

Chuck  died. 

[Interpreted  as  ESCALATED-RETALIATION  with  an  ACHIEVED-RESULT] 

THE  RESULT  WHERE  CHUCK  WAS  KILLED  WAS  WORSE  THAN  THE  ONE  IN  WHICH 
SAM  RECEIVED  A  CONCUSSION.  NOT  ONLY  WAS  THE  OUTCOME  II  THE  NEWER 
SITUATION  ACCIDENTAL,  BUT  RANDY  BOTH  INTENDED  AND  CAUSED  MORE  HARM 
THAN  TERRY. 

THE  INTENT  OF  RANDY,  THE  OFFENDER  IN  THE  OLDER  CRIME,  TO  ACT 
REPEATEDLY  TO  STAB  CHUCK  TO  DEATH  WAS  MORE  SEVERE  THAN  THAT  OF 
TERRY,  THE  OTHER  OFFENDER,  TO  ACT  REPEATEDLY  TO  HIT  SAM.  IN 
ADDITION,  ALTHOUGH  NEITHER  ACTOR’S  INTENTIONS  WERE  JUSTIFIED, 

RANDY  ESCALATED  THE  LEVEL  OF  VIOLENCE,  WHILE  TERRY  DID  NOT. 

COMPARISON  FINISHED  WITH  RESULT  THAT  THE  OLD  CRIME, 

CRIME 1,  WAS  WORSE. 


THE  SENTENCE  ORIGINALLY  GIVEN  FOR  CRIME1,  FOR  VIOLATION  OF  MURDER, 
WAS  A  TERM  OF  IMPRiSONMENT  OF  NOT  LESS  THAN  40  YEARS  NOR  MORE  THAN 
SO  YEARS  TO  BE  SERVED  IN  THE  STATE'S  PRISON.  SINCE  THE 
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Program 

Year 

Domain 

Task 

CYRUS 

1980 

Diplomacy 

Memory  organization  and  retrieval 

IPP 

1980 

Terrorism 

Story  understanding  /  learning 

MEDIATOR 

1985 

Mediation 

Case-based  problem  solving 

JUDGE 

1986 

Law 

Case-based  assessment 

CHEF 

1986 

Cooking 

Case- based  planning  /  learning 

Table  1:  Early  case-based  systems 


CIRCUMSTANCES  OF  CRIME1  ARE  FOUND  TO  BE  WORSE  THAN  CRIME8 ,  DUE  TO 
MORE  SEVERE  ACTIONS  AND  RESULTS  AT  THE  END  OF  THE  CRIME,  THE 
OFFENDER  WILL  GET  A  SENTENCE  WHICH  IS  MORE  LENIENT  THAN  THE 
SENTENCE  FOR  CRIME1,  RELATIVE  TO  THE  CRIME  OF  ASSAULT  IN  THE 
SECOND  DEGREE. 

THE  SENTENCE  TO  BE  GIVEN  FOR  CRIME8,  FOR  VIOLATION  OF  ASSAULT  IN 
THE  SECOND  DEGREE  AS  DEFINED  IN  SECTION  53A-60  IN  THE  CONNECTICUT 
PENAL  CODE,  WILL  BE  A  TERM  OF  IMPRISONMENT  OF  NOT  LESS  THAN  3 
YEARS  TO  BE  SERVED  IN  THE  STATE'S  PRISON.  THE  MAXIMUM  PERIOD  OF 
INCARCERATION  ALLOWED  FOR  VIOLATION  OF  THIS  STATUTE  IS  S  YEARS. 

This  example  illustrates  some  of  the  main  aspects  of  case-based  reason¬ 
ing.  First,  JUDGE  has  a  case  library  comprising  an  episodic  memory  of 
previously  adjudicated  crimes.  Second,  new  cases  are  analyzed  to  provide 
indices  for  retrieving  past  cases.  Third,  JUDGE  can  compare  the  new  case 
with  the  old  case  to  determine  how  the  new  situation  may  require  modifi¬ 
cation  of  the  prior  sentence.  Fourth,  JUDGE  provides  an  explanation  of  its 
reasoning  by  explicit  analysis  and  comparison  of  the  two  cases.  Finally,  the 
new  case  becomes  assimilated  into  JUDGE’S  case  library  for  future  use. 

Hammond’s  CHEF  program  [Ham84,  IlamS6]  developed  new  plans  based 
on  its  own  experience  in  the  domain  of  cooking.  When  faced  with  the  task  of 
preparing  a  dish  for  which  it  had  no  appropriate  plan  (recipe),  CHEF  would 
modify  an  existing  plan  to  fit  the  new  situation,  and  then  try  to  detect  and 
correct  any  errors  that  resulted,  CHEF  would  learn  from  its  own  mistakes. 
An  annotated  example  from  CHEF  is  shown  in  Appendix  B. 

Table  1  summarizes  these  early  programs,  all  of  which  represent  com¬ 
pleted  Ph.D.  research.  Recent  work  in  case-based  reasoning  has  proceeded 
apace,  reflecting  a  wide-spread  and  growing  interest  in  the  case- based  paradigm. 
Current  case-based  research  projects  are  summarized  in  table  2.  This  list  is 
not  exhaustive,  merely  illustrative.  These  efforts  demonstrate  a  wide  range 
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Program 

Citation 

Site 

Domain 

Task 

PLEXUS 

[Aitse] 

Travel 

Adaptive  planning 

CBD 

[HHS8] 

Chicago 

Machines 

Case-based  diagnosis 

TRUCKER 

[MIIC88] 

Chicago 

Scheduling 

Pluralistic  planning 

CYCLOPS 

[N  avSSj 

CMU 

Landscaping 

Design  problem  solving 

PERSUADER 

[SyeSS] 

CMU 

Mediation 

Plan  adaptation  and  repair 

PRODIGY 

[cvssj 

CMU 

Algebra 

Derivational  analogy 

CBR  Shell 

CSI 

Tool 

Programming  shell 

JULIA 

[ShiSS] 

GA  Tech 

Cooking 

Analogical  reasoning 

MEDIC 

[TurS8] 

GA  Tech 

Medicine 

Diagnostic  reasoning 

PARADYME 

[KolSS] 

GA  Tech 

Cooking 

Parallel  memory  retrieval 

n/a 

[BM88] 

Lockheed 

Machines 

Explanation-based  learning 

CASEY 

[I\ot8S] 

MIT 

Medicine 

Reasoning  about  evidence 

n/a 

[WDII88] 

TI 

Military 

Tactical  planning 

JOHNNY 

[StaSS] 

TMC 

Reading 

Memory-based  reasoning 

CBS 

[BL88] 

UMass 

Puzzles 

Case- based  search 

HYPO 

[RA88] 

UMass 

Law 

Case-based  reasoning 

TA 

[Wil88] 

UMass 

Programming 

Case-based  learning 

ANON 

[Owe83] 

Yale 

Proverbs 

Indexing  prototypical  cases 

DECIDER 

[Far88] 

Yale 

History 

Case-based  teaching 

DMAP 

[RM35] 

Yale 

Economics 

Direct  memory  access  parsing 

IVY 

[IIun85] 

Yale 

Medicine 

Case-based  diagnosis 

SWALE 

[KL88] 

Yale 

Post-mortem 

Case-based  explanations 

Table  2:  Current  case-based  research  projects 


of  domains  and  research  issues  that  have  flowed  from  the  case-based  reason¬ 
ing  paradigm. 

4  Summary 

In  this  paper  we  have  reviewed  some  of  the  beginnings,  motivations,  and 
trends  in  case-based  reasoning  research.  Case-based  reasoning  grew  out  of 
psychological  models  of  episodic  memory  and  the  technological  impetus  of 
artificial  intelligence.  In  recent  years,  interest  in  case-based  reasoning  has 
grown  across  the  country. 

The  two  long-term  agendas  of  case-based  reasoning  remain:  to  develop  a 
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scientific  model  of  human  memory,  and  to  build  robust  computer  programs 
that  can  assimilate  experiences  and  adapt  to  new  situations.  As  the  results 
of  the  past  few  years  seem  to  demonstrate,  these  enterprises  appear  to  be 
synergistic. 
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A  Appendix:  Case-based  learning  in  IPP 

The  program  IPP  [LebSO]  demonstrates  the  role  of  reminding  in  learning. 
IPP  was  a  natural  language  program.  Its  acronym  stood  for  Integrated 
Partial  Parsing,  which  relates  to  how  IPP  would  convert  English  sentences 
into  a  conceptual  representation. 

Below  we  present  a  transcript  of  IPP  reading  three  news  stories  about 
shootings  in  Northern  Ireland. 

IPP  created  13-Feb-81  13:11:21,  ready  25-Jul-85  14:10:21 
♦(PARSE  XXI) 

Story:  XXI  (4  12  79)  NORTHERN -I RELAND  NONE 

(IRISH  REPUBLICAN  ARMY  GUERRILLAS  AMBUSHED  A  MILITARY  PATROL  IN 
WEST  BELFAST  YESTERDAY  KILLING  ONE  BRITISH  SOLDIER  AND  BADLY 
WOUNDING  ANOTHER  ARMY  HEADQUARTERS  REPORTED) 

Processing: 

IRISH  REPUBLICAN  ARMY 
:  Phrase 

IRA  :  Token  refiner  -  save  and  skip 

GUERRILLAS  :  Interesting  token  -  GUERRILLAS  OF  THE  IRA 


Instantiated  I-TERRQRISM  structure 

Predictions  -  I-TERRORISM-SYN-FINDER  I-TERRORISM-SUB-STRUCTURE 
INFER- I-TERRORISM-SUB-STRUCTURES 
REDUNDANT-SCRIPT-WORDS  DEFAULT-ORGANIZATION 
DEFAULT-VICTIM-TYPE  COUNTER-MEASURES 

»>  Beginning  memory  update  — 

New  features:  EVO  (XXI)  (I -TERRORISM) 

ACTOR  ORG  IRA 

POL-POS  BAD-GUY 

AFFILIATION  CATHOLIC 
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LOCATION  AREA  WESTERN -EUROPE 

NATION  ^NORTHERN- IRELAND* 


Bast  existing  S-MOP(s)  — 

I-TERRORISM 

At  this  point,  IPP  has  started  reading  story  XXI.  IPP  recognizes  that  it 
is  an  instance  of  terrorism.  There  are  a  number  of  things  that  IPP  expects 
to  see  in  the  rest  of  the  story  dealing  with  typical  terrorist  activities.  The 
program  begins  to  build  a  conceptual  representation  of  the  story,  labeled 
EVO,  which  at  this  point  includes  just  the  actor  and  location  of  the  event. 

The  program  proceeds  in  a  similar  fashion  to  the  end  of  the  story,  pro¬ 
ducing  the  following  conceptual  representation. 

Indexing  EVO  (XXI)  as  variant  of  I-TERRORISM 
>»  Memory  incorporation  complete 


I-TERRORISM 
GUERRILLAS  OF  THE  IRA 
IRISH  MILITARY  PATROL 


S- ATTACK-PERSON 
GUERRILLAS  OF  THE  IRA 
IRISH  MILITARY  PATROL 


Story  Representation: 

**  MAIN  EVENT  ** 

EVO  » 

MEM-NAME 
ACTOR 
VICTIM 
INSTANCES 
EV2  » 

MEM-NAME 
ACTOR 
VICTIM 
METHODS 
EV1  * 
MEM-NAME 
ACTOR 
VICTIM 
RESULTS 
EV3  * 
MEM-NAME 
ACTOR 
VICTIM 


$AMBUSH 

GUERRILLAS  OF  THE  IRA 
IRISH  MILITARY  PATROL 


CAUSE-DEATH 
GUERRILLAS  OF  THE  IRA 
IRISH  MILITARY  PATROL 
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HEALTH  -10 

EV4  » 

MEM-NAME  CAUSE-WOUND 
ACTOR  GUERRILLAS  OF  THE  IRA 

HEALTH  -S 

TIME  YESTERDAY 


5121  msec  CPU  (0  msec  GC) ,  41000  msec  clock,  7417  conses 
NIL 


IPP’s  representation  of  death  (HEALTH  =  -10)  was  somewhat  prosaic. 
However,  the  program  basically  got  the  facts  right  and,  more  importantly, 
would  remember  what  it  had  read. 

Next,  we  give  IPP  a  second  story,  XX2,  about  Northern  Ireland. 

♦(PARSE  XX2) 

Story:  XX2  (11  11  79)  NORTHERN- IRELAND  NONE 

(A  SUSPECTED  IRISH  REPUBLICAN  ARMY  GUNMAN  KILLED  A  50  -YEAR-OLD 
UNARMED  SECURITY  GUARD  IN  EAST  BELFAST  EARLY  TODAY  THE  POLICE  SAID) 

Processing: 

A  :  Function  word  -  Token  refiner  -  save  and  skip 

SUSPECTED  :  Dull  verb  -  skipped 

IRISH  REPUBLICAN  ARMY 
:  Phrase 

IRA  :  Token  refiner  -  save  and  skip 

GUNMAN  :  Interesting  token  -  GUNMAN  OF  THE  IRA 

Predictions  -  TERRORISM  ROBBERY  KIDNAPPING-SCRIPT 
LOOK-FOR-GUNMAN- ASSOCIATED-SCRIPT 
FIND-GUNMAN-ASSOC-SIBLING 

KILLED  :  Word  satisfies  prediction 

Prediction  confirmed  -  FIND-GUNMAN-ASSOC-SIBLING 

Instantiated  CAUSE-DEATH  structure 
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Predictions  -  REDUNDANT-SCRIPT-WORDS  INFER-REASON-FOR-DEATH 
FIND-REASON-FOR-DEATH  IMPORTANT-VICTIM 
CAUSE-DEATH-ROLE-FINDER  END-ROLE-FINDER 

IPP  continues  in  this  vein,  but  along  the  way,  the  program  is  reminded 
of  the  first  story  (XXI).  It  then  creates  a  Memory  Organization  Packet 
(MOP  [Sch82])  noting  the  similarities  between  the  two  stories. 

Creating  more  specific  S-ATTACK-PERSON  (SpM3)  from  events 
EV2  (XXI)  EV6  (XX2)  with  features: 


VICTIM 

(1) 

ROLE 

AUTHORITY 

POL-POS 

ESTAB 

ACTOR 

(1) 

ORG 

IRA 

POL-POS 

BAD-GUY 

AFFILIATION 

CATHOLIC 

RESULTS 

(1) 

AU 

HURT-PERSON 

HEALTH 

-10 

LOCATION 

(1) 

AREA 

WESTERN-EUROPE 

NATION 

♦NORTHERN- IRELAND* 

I-MOP 

(1) 

I-MOP 

I-TERRORISM 

Reminded 

of : 

EV2  (XXI)  (MOP 

creation) 

>»  Memory  incorporation  complete 


Story  Representation: 

**  MAIN  EVENT  ** 

EV8  » 

MEM-NAME  I -TERRORISM 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  50  YEAR  OLD  IRISH  UNARMED  GUARD 

PLACE  EAST  BELFAST 

INSTANCES 
EV6  * 

MEM-NAME  S-ATTACK-PERSON 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  50  YEAR  OLD  IRISH  UNARMED  GUARD 
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RESULTS 
EVS  = 

MEM-NAME  CAUSE-DEATH 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  50  YEAR  OLD  IRISH  UNARMED  GUARD 

HEALTH  -10 

PLACE  EAST  BELFAST 

METHODS 
EV7  * 

MEM-NAME  $SHOOT 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  50  YEAR  OLD  IRISH  UNARMED  GUARD 

PLACE  EAST  BELFAST 

PLACE  EAST  BELFAST 

TIME  TODAY 

3464  msec  CPU  (0  msec  GC) ,  14000  msec  clock,  6677  conses 
NIL 

Finally,  we  give  IPP  a  third  story  about  a  shooting  in  Northern  Ireland, 
but  in  this  case  the  gunman  is  not  identified. 

♦(PARSE  XX3) 

Story:  XX3  (1  12  80)  NORTHERN- IRELAND  NONE 

(A  GUNMAN  SHOT  AND  KILLED  A  PART-TIME  POLICEMAN  AT  A  SOCCER 
MATCH  SATURDAY  AND  ESCAPED  THROUGH  THE  CROWD  TO  A  WAITING 
GETAWAY  CAR  ♦COMMA*  POLICE  SAID) 

Processing: 

A  :  Function  word  -  Token  refiner  -  save  and  skip 

GUNMAN  :  Interesting  token  -  GUNMAN 

Predictions  -  TERRORISM  ROBBERY  KIDNAPPING-SCRIPT 
LOOK-FOR-GUNMAN- ASSOCIATED-SCRIPT 
FIND-GUNMAN-ASSOC-SIBLING 


SHOT 


:  Word  satisfies  prediction 
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Prediction  confirmed  -  LOOK-FOR-GUNMAN-ASSOCIATED-SCRIPT 

IPP  reads  along  some  more,  but  when  it  starts  to  update  memory,  it 
comes  across  the  Specification  MOP  that  it  had  previously  created  from  the 
first  two  stories. 

»>  Beginning  memory  update _ 


New  features: 

EV10  (XX3)  (S-ATTACK-PERSON) 

ACTOR 

POL-POS 

BAD-GUY 

METHODS 

AU 

$SH00T 

LOCATION 

AREA 

WESTERN-EUROPE 

NATION 

*NORTHERN-IRELAND* 

Best  existing 

S-MOP(s)  — 

SpM3  —  potential  remindings: 

EV6  (XX2) 

Predicted  features  (SpM3) 

RESULTS 

HEALTH 

-10 

AU 

HURT-PERSON 

ACTOR 

AFFILIATION 

CATHOLIC 

ORG 

IRA 

VICTIM 

POL-POS 

ESTAB 

ROLE 

AUTHORITY 

I-MOP 

I-MOP 

I-TERRORISM 

»>  Memory  update  complete 

IPP  continues,  and  when  it  finishes  the  story,  IPP  incorporates  the  fea¬ 
tures  from  its  previous  generalization.  Specifically,  IPP  infers  that  the  gun¬ 
man  is  a  member  of  the  IRA. 

Indexing  EV10  (XX3)  as  variant  of  SpM3 
Reminded  of  EV6  (XX2)  (Last  MOP  reference) 

Reminded  of  EV6  (XX2)  (varies  from  MOP  in  same  way) 

Adding  default  feature  ACTOR  ORG  IRA  to  EV10 
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>»  Memory  incorporation  complete 


Story  Representation: 

**  MAIN  EVENT  ** 

EV10  * 

MEM-NAME  S- ATTACK -PERSON 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  PART-TIME  POLICEMAN  AT  SOCCER  MATCH 

METHODS 
EV9  ■ 

MEM-NAME  $SH00T 

ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  PART-TIME  POLICEMAN  AT  SOCCER  MATCH 

RESULTS 
EVli  « 

MEM-NAME  CAUSE-DEATH 
ACTOR  GUNMAN  OF  THE  IRA 

VICTIM  PART-TIME  POLICEMAN  AT  SOCCER  MATCH 

HEALTH  -10 

TIME  SATURDAY 

SCENES 
EV12  » 

MEM-NAME  SS-ESCAPE 

ACTOR  GUNMAN  OF  THE  IRA 


5926  msec  CPU  (1887  msec  GC),  27000  msec  clock,  7252  conses 
NIL 


The  timings  at  the  end  of  each  run  indicate  the  speed  of  IPP.  Note  that 
most  each  of  the  stories  were  processed  in  under  a  minute,  with  only  a  few 
seconds  of  actual  computer  time.  The  program  was  written  in  UCI-LISP 
and  ran  on  a  DEC  2060  time-shared  mainframe. 
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B  Appendix:  Case-based  planning  in  CHEF 

CHEF  (Ham84,  Ham86]  is  a  computer  program  in  the  domain  of  cooking 
which  generates  original  plans,  which  take  the  form  of  recipes,  by  modifying 
existing  plans.  It  demonstrates  how  episodic  knowledge  can  be  used  to  guide 
planning  and  avoid  past  failures. 

When  presented  with  a  problem  -  how  to  prepare  a  certain  dish  -  the 
program  is  reminded  of  previous  related  recipes.  It  modifies  the  most  similar 
previous  recipe  to  fit  the  new  requirements,  and  then  tries  out  the  new  recipe. 
CHEF  tests  the  recipe  through  a  simulation  involving  rules  which  specify 
the  physical  effects  of  each  step  of  the  cooking  process.  The  results  are  then 
examined  to  see  if  they  match  the  goals  of  the  intended  dish.  If  the  program 
recognizes  a  failure,  it  then  tries  to  analyze  and  explain  the  failure  through 
a  process  of  reasoning  by  asking  questions.  Finally,  the  program  modifies 
the  recipe  in  light  of  its  explanation  to  correct  the  failure.  This  case-based 
planning  process  closely  follows  the  flow  chart  given  in  figure  1. 

In  the  following  example,  the  program  has  been  asked  by  the  user  to 
make  a  souffle  with  strawberries.  We  present  annotated  output  from  the 
program. 

Searching  for  plan  that  satisfies  - 
Include  strawberry  in  the  dish. 

Make  a  souffle. 

Found  recipe  ->  REC4  VANILLA-SOUFFLE 

Recipe  exactly  satisfies  goals  -> 

Make  a  souffle. 

Recipe  must  be  altered  to  match  -> 

Include  strawberry  in  the  dish. 

Building  new  name  for  copy  of  VANILLA-SOUFFLE  based  on  its  goals. 
Calling  recipe  STRAWBERRY -SOUFFLE 


The  program  is  reminded  of  a  previous  related  recipe  for  Vanilla  Souffle. 
It  then  copies  and  modifies  the  recipe  to  add  strawberries.  The  computer 
simulates  the  execution  of  the  recipe  to  see  if  its  goals  are  satisfied.  It 
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discovers  that  most  of  the  goals  are  met:  the  batter  is  baked,  the  dish  tastes 
like  berries,  the  dish  is  sweet,  etc.  However,  there  are  some  important  goals 
that  failed. 

Checking  for  negative  features  -> 

Unfortunately:  The  batter  is  now  a  bad  texture. 

In  that:  The  batter  is  now  flat. 

Recipe  ->  STRAWBERRY-SOUFFLE  has  failed  goals. 

The  goal:  The  batter  is  now  risen, 
is  not  satisfied. 

Changing  name  of  recipe  STRAWBERRY-SOUFFLE 
to  BAD-STRAWBERRY-SOUFFLE 

The  program  now  tries  to  learn  from  this  failure  by  asking  questions  and 
explaining  why  the  failure  happened. 

ASKING  THE  QUESTION:  ’What  is  the  failure?’ 

ANSWER->  The  failure  is:  It  is  not  the  case  that: 

The  batter  is  now  risen. 

ASKING  THE  QUESTION:  ’What  is  the  preferred  state?' 

ANSWER->  The  preferred  state  is:  The  batter  is  now  risen. 

ASKING  THE  QUESTION:  ’What  was  the  plan  to  achieve  the 
preferred  state?’ 

ANSWER->  The  plan  was :  Bake  the  batter  for  twenty  five  minutes . 

ASKING  THE  QUESTION:  ’What  were  the  conditions  that  led 
to  the  failure?’ 

ANSWER->  The  condition  was :  There  is  an  imbalance  between 
the  whipped  stuff  and  the  thin  liquid. 

************  noting  balance  failure  ************ 

Only  one  aspect  of  the  imbalance: 
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There  is  an  imbalance  between  the  whipped  stuff  and  the  thin  liquid, 
is  unexpected. 

The  state: 

There  is  whipped  stuff  in  the  bowl  from  the  total  equaling  60  teaspoons, 
normally  participates  in  the  goal: 

The  batter  is  now  risen. 

Only  the  other  aspect  of  the  imbalance: 

There  is  thin  liquid  in  the  bowl  from  the  strawberry  equaling 
2.4  teaspoons 

is  an  unexpected  condition. 

The  program  continues  its  analysis  and  eventually  decides  to  modify  the 
recipe  to  reduce  the  imbalance  between  the  whipped  egg  whites  and  the  liq¬ 
uid  from  the  strawberry  mixture.  The  program  uses  Thematic  Organization 
Packets  (TOPs  [Sch82])  to  make  the  high  level  association  necessary  to  alter 
the  plan.  It  has  five  strategies  which  it  considers. 

Found  TOP  T0P3  ->  SIDE-EFFECT: DISABLED-CONDITION: BALANCE 
TOP  ->  SIDE-EFFECT:  DISABLED-CONDITION -.BALANCE  has  5 
strategies  associated  with  it: 

USE-DIFFERENT-PLAN : PLAN 1 

USE-DIFFERENT-PLAN :PLAN2 

ADJUNCT-PLAN 

RECOVER 

ADJUST-BALANCE 

Applying  TOP  ->  SIDE-EFFECT: DISABLED-CONDITION: BALANCE 
to  failure  It  is  not  the  case  that:  The  batter  is  now  risen, 
in  recipe  BAD-STRAWBERRY-SOUFFLE 

Asking  questions  needed  for  evaluating  strategy: 

USE-DIFFERENT-PLAN : PLAN 1 

ASKING  -> 

Is  there  an  alternative  to 
Pulp  the  strawberry, 
that  will  enable 
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The  dish  now  tastes  like  berries, 
which  does  not  cause 

There  is  thin  liquid  in  the  bowl  from  the  strawberry 
equaling  2.4  teaspoons 

Found  plan:  Instead  of  doing  step:  Pulp  the  strawberry 
do:  Using  the  strawberry  preserves. 

The  program  continues  to  evaluate  the  other  four  strategies,  compares 
the  results,  and  finally  decides  to  apply  the  ADJUST-BALANCE  strategy, 
which  in  this  case  means  to  add  more  egg  whites. 

Changing  name  of  recipe  BAD-STRAWBERRY- SOUFFLE 
to  STRAWBERRY-SOUFFLE 

Implementing  plan  ->  Increase  the  amount  of  egg  white  used. 
Suggested  by  strategy  ADJUST-BALANCE 

New  recipe  is  ->  STRAWBERRY-SOUFFLE 

STRAWBERRY-SOUFFLE 

Two  teaspoons  of  vanilla 

A  half  cup  of  flour 

A  quarter  cup  of  sugar 

A  quarter  teaspoon  of  salt 

A  half  cup  of  milk 

Two  cups  of  milk 

One  piece  of  vanilla  bean 

A  quarter  cup  of  butter 

Five  egg  yolks 

Six  egg  whites 

One  cup  of  strawberry 

Mix  the  flour  with  the  sugar  and  salt. 

Mix  the  milk  with  the  mixture  of  sugar,  salt  and  flour. 

Boil  the  milk  and  vanilla  bean  for  less  them  a  half  minute. 

Remove  the  vanilla  bean  from  the  milk. 

Mix  the  mixture  of  milk,  sugar,  salt  and  flour  with  the  milk. 
Simmer  the  mixture  of  milk,  sugar,  salt  and  flour  for  five  minutes. 
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Whip  the  egg  yolk. 

Add  the  butter  and  mixture  of  egg  yolk  to  the  mixture  of  milk, 
sugar,  salt  and  flour. 

Cool  the  mixture  of  egg  yolk,  milk,  sugar,  salt,  flour  and  butter. 
Whip  the  egg  white . 

Add  the  vanilla  and  mixture  of  egg  white  to  the  mixture  of  egg  yolk, 
milk,  sugar,  salt,  flour  and  butter. 

Pulp  the  strawberry. 

Mix  the  strawberry  with  the  spices,  egg,  milk,  salt,  flour  and 
butter. 

Pour  the  mixture  of  egg,  spices,  strawberry,  salt,  milk,  flour 
and  butter  into  a  nine  inch  baking-dish. 

Bake  the  batter  for  twenty  five  minutes. 

If  this  plan  is  successful,  the  following  should  be  true: 

The  batter  is  now  baked. 

The  batter  is  now  risen. 

The  dish  now  tastes  like  berries. 

The  dish  now  tastes  sweet. 

The  dish  now  tastes  like  vanilla. 

Once  all  new  interactions  have  been  validated,  the  new  recipe  is  indexed 
in  the  data  base  in  terms  of  those  interactions.  When  the  program  is  then 
given  the  task  of  creating  a  raspberry  souffle,  it  is  reminded  of  the  dish  it 
just  created  and  produces  a  new  recipe  which  has  no  failures.  The  program 
has  learned  by  analyzing  failures  through  asking  questions. 

The  CHEF  program  illustrates  case-based  reasoning  and  learning.  The 
program  was  presented  with  a  situation  for  which  it  had  no  exact  previous 
match.  It  was  reminded  of  a  similar  previous  case,  and  used  that  as  the  basis 
for  solving  the  new  problem.  In  the  course  of  adapting  that  previous  case  to 
fit  the  new  situation,  the  program  encountered  several  additional  problems, 
but  was  able  to  respond  to  those  on  the  basis  of  previous  cases  as  well.  This  is 
an  example  of  creative  reasoning.  When  it  encountered  failures,  the  program 
was  able  to  reason  by  asking  questions.  That  is,  it  explained  the  failures 
through  a  question-based  reasoning  chain.  These  reasoning  mechanisms 
contribute  to  the  adaptive  learning  ability  and  creativity  of  the  program. 


